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ACOUSTIC ECHO AND NOISE CANCELLATION 
BACKGROUND OF THE INVENTION 

Field Of The Invention 

rOOOll The invention relates to a filter ar , doncribod in tho pr e amble of Claim 1 comprising at 

least two inputs for receiving at least two signals, and an output for supplying an output signal , 

5 [00021 ^The invention fiirther relates to a signal processing device comprising such a filter. 

[00031 Th e inv e ntion fiirther r e lat e s to a t e l e conf e rencing system. 

Furth e r th e inv e ntion r e lat e s to a voic e controll e d e lectronic d e vic e . 

Th e inv e ntion also r e lat e s to a nois e canc e llation svstem T he invention fiirther relates to a 

teleconferencing system, a voice-controlled electronic device, and a noise cancellation system . 

1 0 [00041 The invention fiirther relates to a method as described in th e pr e amble of claim 11 for 

filtering at least two signals and for supplying an output signal . 

[00051 ^Recent developments in audio and video systems require the use of multiple channel 

processing and reproduction with acoustic echo cancellers (AEC) and noise cancellers. For example 
15 in mifti -mini-g roup video conferencing systems^ multiple channel transmission leads to a better 

"localization" of the diverse people in the room. This enhances the intelligibility and naturalness of 
the speech. 

Further^ multiple channel echo cancellation is needed in veiee -voice- controlled stereo audio and 
video equipment^ such as television receivers, radio receivers, CD players^ etc.T 

2 0 [00061 A multiple channel AEC can^ in general^ not be created by_a simple combination of 

multiple single channel AEC's. 

Description Of The Related Art 
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[00071 From th e Unit o d States patent US A U.S. Patent 5,828,756 a method and apparatus are 

Icnown o f discloses a stereophonic communication system^ such as a teleconferencing system, which 
involves selectively reducing the correlation between the individual channel signals of the 
stereophonic system. Herein^ non-linearities are added to the input signals to reduce the correlation. 
However by adding these non-linearities^ audible artifacts in the output signals are introduced. These 
non-linearities can (sometimes) be accepted in teleconferencing systems but are certainly not 
acceptable in other applications^ such as supplying music^ etc. 

SUMMARY OF THE INVENTION 
[00081 It is, inter alia, an object of the invention to provide a filter, which overcomes the 

objections of the prior art. To this end a first aspect of the invention provides a filter as claim e d in 
claim 1 described in the opening paragraph, characterized in that the coefficient updates are 
determined in a transformed domain, and the filter comprises means for reducing the effect of 
correlation between the i9nput signals on the coefficient updates . 

[0009] Herewith^ the performance of the adaptive filters is improved without a huge increase 

in computational complexity. 

A second asp e ct of th e inv e ntion provid e s a signal proc e ssing d e vic e as claimed in claim 8. 

A third asp e ct of th e inv e ntion provid e s a t e l e confer e ncing system as claimed in claim 1 1 . 

A fourth asp e ct of th e invention provid e s a voic e controll e d e lectronic d e vic e as claimed in claim 12. 

A fifth aspect of th e inv e ntion provid e s a noise cancellation system as claimed in claim 13. 

A sixth aspect of th e inv e ntion provid e s a m e thod as claim e d in claim 11. 
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An e mbodim e nt of th e invontion compris e s tho f e atur e s of claim 2. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 rOOlOl The invention and additional features, which may be optionally used to implement the 

invention to advantage^ will be apparent from and elucidated with references to the examples 
described below, hereinafter and shown in the figur e s. Herein shows accompanying drawings, in 
which : 

[00111 Figure 1 schematically.shows the multiple input adaptive FIR filter, according to the 

10 invention^; 

[0012] Figure 2 schematicall y shows the calculation of the output of the FIR filter, according 

to the invention^; 

[00131 Figure 3 schematically^hows the calculation of Y in the Multiple Input Partitioned 

Frequency Domain adaptive filter, according to the invention for the case with direct inverse power 
15 estimation^; 

[00141 Figure 4 schemaficall v shows the calculation of the coefficient vectors according 

to the invention^; 

[00151 Figure 5 shows a schematic example of a stereo echo cancellation in a 

teleconferencing system according to the invention, 
2 0 [00161 Figure 6 shows a more detailed schematic example of a teleconferencing system 

according to the invention^; 

[00171 Figure 7 shows a schematic example of a voice controlled device according to the 

invention-i_aHd 

[00181 Figure 8 shows a schematic example of a noise canceller according to the invention; 

25 and 
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[00191 Figure 9 schematically shows the determining of the input chaimers power matrix . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[00201 In the description^ the equations, matrices, etc^ are shown as described below. Signals 

5 are denoted by lower case characters, constants by upper case. Underlining is used for vectors, lower 
case for time domain, and upper case for frequency domain. Matrices are denoted by bold face upper 
case, like ^.g.. I. The dimension is put in superscript (e.g.^ ±eBxQ matrix X is given by X^^Q, for a 
square matrix the second dimension is omitted). Diagonal mafrH ^matrices are denoted by a double 
underline, like -e.g., P, with its diagonal denoted as 
10 A subscript i, ltk» €.g.. wj. denotes the I'th version. The ^'th element of w is given by (w)^ Finally, 
appending [k] denotes the time index, denotes the transpose, (.)* denotes the complex conjugate^ 
and (.)^ denotes t he Hermitain transpose (complex conjugate transpose). 

[00211 A general multiple input adaptive FIR filter, depicted in fi^age -Figure 1 , uses the S 

signals [k] ua^to [k] to remove unwanted components correlated with these signals in the 
1 5 signal e[k] . The signals Xq [k] entil-to. ;c,., [k] are input to S FIR-filters uatil-to. W^_i , with 

outputs go W witil-to.e,_, [k]. The goal of the update algorithm is to adapt the coefficients of the FIR 
filters in such a way that the correlation between r[k] and the input signals [k] and [k] is 
removed. 

20 

[00221 For 5 > a > 0 i the FIR filter Wa performs the convolution of the signal Xa[k] and the 

coefficients Wa,o[k] . . . Wa,N.i[k] of that filter. The output signal ea[k] of such a filter can be described 
as follows 



25 ^„w=zxj^-/]->v„,w4:wy ■w:[k] 



(1) 



1=0 
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With^for S>a>0^ 



(x^[k-N + l]] 



(2) 



."[*]= 



w. 



(3) 



[00231 



The output of the multiple input adaptive filter is given by 



r[k] = e[k]-J^eM 

a=0 



(4) 



[00241 These filter parts of the separate (adaptive) filters Wo until Ws-i can be implemented 

efficiently in fi-equency domain with help of partitioning, block processing and Discrete Fourier 
Transforms (DFTs). A reduction in computational complexity is obtained since the convolutions per 
sample in the time domain transform to element-wise multiplications per block in the fi-equency 
domain. We use block processing with block length B and DFTs of length M, with M >N+B-l. 
The transformation of the input signals can be described for 5 > a > 0 by 



xAkB] 



(5) 
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where F*^ is the M x M Fourier matrix. The (a,b)'th element (for 0 < fl< M,0 < !>< M )of the Fourier 
matrix is given by 



— jlTiab 



M 



(6) 



where j = 'J—i. 



r00251 



The filter can then be computed in the fi-equency domain, by 



10 ikB] = {0 V'^X'^[kB]v';[kB] = 



15 



a=0 



e[kB-B+\]\ 
_ eikB] 



(7) 



Note that the fi-equency domain filter coefficients are related to the time domain coefficients, for all 
S>a>0 this can be denoted by 



frf[/] = F^ 



V 0 , 



(8) 



100261 To obtain an efficient implementation, the block length B must be chosen in the same 

order as the filter length N, which results a large processing delay. 

[00271 To reduce the processing delay, the filter can be partitioned into smaller pieces of 

length and with g = [n / B\v/e get the implementation of figtge- Figure 2, that can be described 

by 
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5-1 g 



M 



#i?] = (0l0-Z 15 [{k-i)B'E.':AkB] 



(9) 



a=0 /=! a 



with ^^,[/] = F^ 



:.»['] 1 
['] 



a,iB+B 

0 



,-.[/] 



[00281 For the update part of the filter^ one can use S separate update algorithms to improve 

5 convergence behavior the input signals can be decorrelated separately in the time domain by using 
RLS like algorithms, leading to a huge computational complexity. Complexity reduction can be 
obtained by implementation in the frequency domain with (partitioned) Block Frequency Domain 
Adaptive Filters^ as described in G.P.M. Egeimeers, Real time realization of large adaptive filters, 
Ph.D. thesis, Eindhoven University of Technology, Eindhoven (The Netherlands), Nov. 1995. When 
1 0 there is correlation between the input signals of the filters^ this might still lead to very bad 
convergence behavior, due to the non-uniqueness problem. 

[00291 In this application^ it is proposed to use a partitioned algorithm in the frequency 

domain that reduces the effect of the cross-correlation between the input signals on the algorithm's 
convergence behavior. To reduce complexity^ block processings with block length A to compute the 
15 sum of A consecutive updates with each iteration^ is used. For 5' > a > 0 ^ the coefficient vectors 
[IA] are partitioned into parts of length Z with = / Z'] such that^ for 5 > y > 0 



w 



PHNLOOOl 72-SS-RED- 1 01 005 



PHNL 000172 



with for 5 > y > 0 and g„ > z > 0 



W 

w 
w 



5 A Fourier transform length L is used with Z > Z + ^ - 1 , we define the input signal Fourier 
transforms for 5 > a > 0 as 



=F^ 



10 The diagonal matrices [IA] contain the vector [IA] as main diagonal, so for 5 > a > 0 
X''^[lA] = diag\xt[lA]\. 

An overlap-save method is used to compute the correlation involved in the adaptation process in the 
15 frequency domain, the frequency domain transform of the residual signal vector equals 



R''[IA] = F\ 
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The set of update equations for the filter coefficients in the MFDAF (Multiple Input Frequency 
Domain Adaptive Filter) algorithm can now be defined for g„ > i > 0 by 















z 


[lA] 






z 


M J 



'{vl^[lA-iZ]y 

{v'^ilA-iZ'fj* 
{Yl[lA-iZ])* 



10 with 



= 2a(p"[M])" 



1 5 and the transformation matrix c^-^'^ '^ is given by 
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... 0^'^^ 












QZ,i qZ.L ^ 



with 



5 G^-^=(j^ 0^-^-^)(f^)"'. 



The input channel's power matrix P^^ \IA\ is defined by 



iS.L 



10 



[/^] = i fx^^'^ [Z^])* .(X^ [lA^ ] 



where 



15 X'^-^M = 
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The expectation operator 8{} of the above equation has to be replaced by an estimation routine. 
f 00301 The power matrix P [IA] can be estimated by 

P^^M = (l-r)P"[(/-lW + ^( X'^-'llA] y .(X "-'[lA])' (10) 

5 [00311 To reduce the number of multiplications, the step-size parameter a of equation is 

incorporated in the above power estimation routine by defining 

pf"M=^p"[M] (11) 

so 

2a(p^^[/4-'=(pf M)-'. (12) 

10 

Estimation of the power matrix P^^ [IA] can then be done by 

P''M=(l-r)'Pa'[(^-lW+ — •( X''''[lA] y •( X""'[lA] )'. (13) 

Direct application of this algorithm leads to stability problems. When the input signal power in a 
15 certain firequency bin is very small, the power in that bin will decrease to a (very) small value. The 
inverse of the matrix will then have large values and will be inaccurate (due to numerical and 
estimation errors) hi the ideal case, the eigenvalues of the power matrix estimate cancel the 
eigenvalues of the input signal power matrix. Due to estimation errors^ this goal is only 
approximated, and the mismatch introduces a deviation fi-om the ideal convergence behavior and 
2 0 might even lead to instability. Especially when some of the eigenvalues of the estimate of the inverse 
power matrix get large, and do not (exactly) cancel a (small) eigenvalue of the input signal power 
matrix, instability might occur. A lower limit to the eigenvalues of the estimate of the power matrix 
can solve this problem. In the single charmel case (or when we forget the cross-terms)^ we can solve 
this problem by applying a lower limit to the lower values. We can do this because the eigenvalues 
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of a diagonal matrix are equal to the elements of the diagonal, so we actually limit the eigenvalues. 
In the multiple channel case we also have to limit the eigenvalues to assure stability, but these no 
longer equal the elements on the diagonal. 

[00321 We know^ however^ that all eigenvalues of the power matrix are positive. We can now 

5 create a lower limit on the eigenvalues by shifting them by the suggested minimum. We know that 
for all eigenvalues X of a matrix A, the determinant of A 4- (P^-^ -A!) I must be zero. So for all A' , 
eigenvalue of A+P^j^-^j - I , there must be a X, eigenvalue of A, such that A'=A.+Pnmi (and the other 
way around). This means that by adding a constant Pmin to the main diagonal of a matrix, all 
eigenvalues of that matrix are shifted by Pmin-)- So we define: 

10 

2a 

which results in 

15 

This is shown in Figure 9 of the drawings. 

[00331 The effect of this shifting of the eigenvalues on the (theoretical ideal) convergence 

b e haviour b ehavior of the algorithm will be very small, and in practice the algorithm is much more 
stable. 

20 

[00341 ^Although P^j^ [IA] is a sparse matrix, computing its inverse would still require L 

inversions of 5x5 matrices, which takes m-on the order of L • 5^ operations. As we^ however^ do not 
need the inverse itself, but only its matrix- vector product with the input signalS:, we can also look at it 
25 as solving the system 



PHNL000172-SS-RED-101005 



12 



PHNL 000172 

















[lAj 




y'^ [ia] , 




X' [lAj ^ 



5 

which requires iston the order of L-S^ operations. Another option is to estimate the inverse of 
P^^ [ia] directly, which also results in a number of operations proportional to LS^ , However, also 
in this case^ we have to limit the eigenvalues to assure stability. 

1 0 [00341 A simple algorithm is given by: 

with 

15 









(44) 
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X,^ [lA] 
X; [lAj 



114} 



[00351 



_We can incorporate a, which results in 



[00361 ^The above algorithm does not guarantee a matrix (p^^^ [lA^ * with positive 

10 eigenvalues, and^ therefore^ introduces a lot of stability problems. In the single channel case^ we are 
able to stabilize the algorithm by using a lower limit on the estimate, which automatically results in 
positive eigenvalues because the matrix is diagonal, but that is not possible in the multiple channel 
case. 



15 Positive eigenvalues 



20 



[00371 An exact transformation of an algorithm for estimating P^^^ [IA] with positive 

eigenvalues will lead to an estimation algorithm for the inverse with positive eigenvalues. This can 

be done by using the matrix inversion lemma. When there is matrix A such that 

A=B + C D E (15) 



then the inverse matrix (A)'* of A can be expressed by 
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(X)-' =(R)-' -(R)-' -c-m-' +E (b;-' c;-' E fB;-' • (i6) 

By choosing 



C = (X^^'^[m])* 



laL 

E = C* =(X^''"'[/^])' 



and 

Q = (B) • C 



(17) 



= E.(B)-' (18) 

= r^-(pf[(/-i)4"'-(x^'''M)' 



10 we obtain by using e quation Equation ( 1 4) 



(Pf-^[/4-' = J-Pf ^[(/-l)^]-' -Q^-'llAliW-llAY .(Q^^-^M)* (19) 
\-Y - 



with 

15 

D^[m]=Mi^ +(X^^-^[iL4])' Q^^'^M- (20) 
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[00381 Algorithm Equation (19) involves no matrix inversion, and only L / 2 + 1 divisions, as 

the matrix [IA] of equation Equation (20) is a real valued diagonal matrix. 

Limits on the eigenvalues 

5 

[00391 An operation on the inverse power matrix that is equivalent to adding a constant to the 

diagonal of the (non-inverse) power matrix^ would solve the problem. Adding a full (5 • Z) x (5 - L) 
identity matrix and trying to find an equivalent operation on the inverse power matrix with the 
matrix inversion lemma, results in an algorithm that requires the matrix inversion we would like to 
10 avoid, so we try 

i':tM=(i-r)P:t[('-i)^]+5^-(xL"N)' -(x^'^'M)' (21) 

with 

15 (X'^''[lA]r -(XL^'^M)' =(X^-^-^[/^])* .(X^-^'^M)' +P^„ -IccL-l'-' . (22) 

r00401 As the matrix I has rank 5 • L and the product matrices (Xf^^^ [IA])* • (Xf^^-^ [IA])' 

and (X^ [U]y ■ (X*^-^ [u])' both have a rank of (at most) U this is not possible for S>1 . As we 
need the average of (X^^'^ [IA])' • (X^^-^ [IA])' , we can find a solution by taking the average over S 
2 0 consecutive updates. We will try to find X{?^'^ [IA] such that 

41 (xL^'^[(/ + c^W • (xL^-M(/ + a)A]y\ 

U=o J (23) 

= f |X (X'-'''[(/ + a)A]y ■ iX""%l + a)A]y^ + ■ 2aLS • I^^ 
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with for / = / mod S 









"5-1,1 * 


xL''[w]= 




+ 













"5-U * 



(24) 



with 



10 



15 



"5-1,5-1 • • ' "5-1,1 "5-1,0 



**1,5-1 
^ "0,5-1 



"1,1 "1,0 



"0,1 "0,0 y 



_For 5 = 1 i we get 



[00411 



(25) 



(26) 



^For S>1^ there are an infinite number of solutions. If we try to keep the maximum 

di s torsion distortion (the largest matrix element) as small as possible, we have to choose^ for all 
S> y>Oand 5>/>0 

Uj,=±^P^-2aL- (27) 

If there is a real symmetric matrix for S=^L^ then a real symmetric matrix U^^ for S = 2L is given 
by 
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(28) 



[00421 ^Using the above equation^ we can construct all U^' with / > 0 . If 5 + 1 is not a power 

of two, then we will use the matrix U^' where 2' > 5 + 1 > 2'"' , and use the last S rows, hi t^le 
Table 1, the power matrix estimation algorithm using a direct inverse estimation with limits on the 
eigenvalues is summarized. 
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Initialization 

1. S =2'^'°*^**'^ 



for i-\to log 2 (5„ )do 
2. begin 



U2'- ^ 



3. Initialize power matrix. 



Iteration 



10 



1- nt'\iA= 



2. Q^^-n/^]=7^'(pi;L[(/-i)4" -(xL^'M^])' 

3. D'M =— I^ +(XL''M/^])' -Q^^-^M 

4. Calculate i^D^llA])-^ 

\-y 

-Q^ (D' [IAY • (Q^ [W])* 
Table 1 : Direct inverse power update with limits. 



5. 



15 
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[00431 ^Note that the inverse of P^^ [IA] is also a sparse matrix with the same structure^ and 

we define 

... is.M I^M' 
... l[M 2^0 M 

... tjA] tJlAl 
5 wherefor 0</<5 and 0<y<5 
Tl[lA]=diag^f,llA]]- 

[00441 Figure 5 shows^ schematically^ an example of a teleconferencing system TS5 using a 

10 stereo echo canceller SEC5 with adaptive filters AF5 (only one shown). The teleconferencing system 
comprises a far room FR5 and a near room NR5. The adaptive filter AF5 has to filter the stereo echo 
signals. 

[00451 Figure 6 shows an example of a stereo echo canceller SEC6 used in a teleconferencing 

system TS6. The stereo echo canceling has to be performed between the near room NR6 and the far 
15 room FR6. In this example^ also programmable filters PF61 and PF62 are used to improve the 

performance of echo canceling. Programmable filters are described in US-A -U.S. Patent 4,903,247. 
[00461 Further^ also the output of the programmable filters is supplied to a dynamic echo 

suppressor DES6, which is coupled with an output to the output of the stereo echo canceller. 
Dynamic echo suppressors are described i n International Patent Application No. WO-97-45995i 
20 corresponding to U.S. Patent 6.546,099 . 

[00471 A full stereo communication requires four stereo AECs, two on the near end side and 

two on the far end side. In figufe -Figure 6. only one of feese -these echo cancellers is depicted. Note 
that on each side we can combine the input signal delay-lines, the FFTs and the multiplication by the 



(Pa!L)-' = 



[lA] 

= 5-1,5-1 L 
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inverse power matrix of the two echo cancellers, which implies that the relative extra computational 
complexity for removing the cross-correlation is even further reduced. The performance of the AECs 
is further improved by adding Dynamic Echo Suppressors as shown. 

[00481 Figure 7 shows another application wherein a stereo echo canceller SEC7 is used in a 

5 veiee -voice- controUed audio (and video) system VCS7. To be able to recognize the local speaker by 
a voice recognition engine^ we have to cancel the sound emitted by the audio set through the 
loudspeakers. This is done by using the stereo echo canceller SEC7. To improve the stereo echo 
canceling^ also^ in this example^ the programmable filters PF71 and PF72 are used, and the Dynamic 
Echo Suppresser DES7 is used. The output of the Dynamic Echo Suppressor is coupled to a voice 

1 0 recognizer VR7 for handling the filtered signal. 

[00491 Figure 8 shows an example of a noise canceller NC8 for canceling the noise received 

on microphones in a room R8 together with a speech signal spl fi-om a person in the room. In this 
example^ the microphones supply signals to a beam former BF8 which beam former supplies signals 
to the noise canceller NC8 and to programmable filters PF81, PF82 and PF83. Further the noise 

15 canceller comprises a dynamic echo suppressor DES8. The output of the Dynamic Echo Suppressor 
is coupled to the output of the noise suppressor to supply an estimate of the received speech sp2. 
[00501 Also in the multiple input noise canceller^ we can apply a DES (which is^ in fact^ not 

suppressing an echo, but is similar to the DES in the AECs case) and programmable filters to 
improve performance, as shown in figufe -Figure 8. An extra problem is that the inputs of the filters 

2 0 may contain some elements of the desired signal ("signal leakage"), because the beam_former is not 
perfect. When the desired signal is speech signal, a speech detector can be used to improve the 
b e haviour b ehavior of the MFDAF. 

[00511 Above some examples of application of a stereo echo canceller and of a noise 

canceller are described. It is to be notic e d noted that the invention can be used in different 
2 5 applications and is not restricted to the described applications. 
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abstracT t of the disclosure 



Stereo echo cancellation is necessary to overcome the objections observed by^ for 
example^ teleconferencing, voice controlled video/audio apparatuses^ etc.T 



To improve the existing filters^ th e inv e ntion provid e s an adaptive filter and -is used along with a 
signal processing device which obtain the coefficient updates in the transformed domain, reducing 
the required calculation complexity. Further^ the filter compris e s m e ans to r e duc eincludes circuitry 
for reducing the correlation between the input signals on the coefficient updates. 
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